Peel back user interface to show hidden functions

ABSTRACT

A user is able to access additional functions not represented in a current image displayed by a graphical user interface. At least one function not presented on the current image is represented by a symbol on an underlying image that is at least partially covered by the current image. When the user performs a predetermined user input (e.g., selecting a corner of the current image), the underlying image and the at least one function represented thereby become accessible. When the user input is performed, a visual effect depicts the current image being at least partially removed from over the underlying image, thereby revealing and permitting access to the at least one additional function. The user input is made by the user performing an action with the user&#39;s hand or another object adjacent to a responsive display, or by using a pointing device to manipulate a displayed image.

BACKGROUND

Because of the widespread popularity of computers, most people havebecome comfortable with conventional computer user input devices such askeyboards and pointing devices. The keystrokes on a keyboard, and thecursor movement and control provided by mice, trackballs, and joysticksand other pointing devices are sufficiently intuitive to providesatisfactory interfaces for most computer-related tasks.

However, as computers become more commonplace throughout ourenvironment, the desire to make computers and their interfaces even moreuser-friendly continues to promote development in this area. Forexample, the MIT Media Lab, as reported by Brygg Ullmer and HiroshiIshii in “The metaDESK: Models and Prototypes for Tangible UserInterfaces,“ Proceedings of UIST 10/1997:14 17,” has developed anotherform of “keyboardless” human machine interface. The metaDESK includes agenerally planar graphical surface that not only displays computingsystem text and graphic output, but also receives user input byresponding to an object placed against the graphical surface. Thecombined object responsive and display capability of the graphicalsurface of the metaDESK is facilitated using infrared (IR) lamps, an IRcamera, a video camera, a video projector, and mirrors disposed beneaththe surface of the metaDESK. The mirrors reflect the graphical imageprojected by the projector onto the underside of the graphical displaysurface to provide images that are visible to a user from above thegraphical display surface. The IR camera can detect IR reflections fromthe undersurface of an object placed on the graphical surface, to detectthe object and its disposition.

Others have been developing similar keyboardless interfaces. Forexample, papers published by Jun Rekimoto of the Sony Computer ScienceLaboratory, Inc. and associates describe a “HoloWall” and a “HoloTable”that display images on a surface and use IR light to detect objectspositioned adjacent to the surface.

By detecting a specially configured object or by detecting IR reflectedlight from an object disposed on a graphical display surface, themetaDESK can respond to the contemporaneous placement and movement ofthe object on the display surface to carry out a predefined function,such as displaying and moving a map of the MIT campus. Thus, computingsystems such as the HoloWall and metaDESK may provide a more naturaldegree of human-machine interaction by providing the means for acomputer to respond to specific objects in a defined manner. Byfacilitating a more natural input arising from the person's interactionwith a graphical display, such technologies broaden and extend themanner in which a user might provide input to a computing system. Thisextended ability, however, does present some concerns, which are notnecessarily unique to this form of user interaction with applicationsand an operating system. Indeed, graphical user interfaces often becomecrowded with icons used to invoke commands, functions, and applications.Thus, as a graphic user interface display screen becomes increasinglyvisually busy, it also becomes increasingly easy for a user tounintentionally invoke an unintended function. This problem can occur inregard to all types of user interactive displays.

FIG. 1A shows a computer display screen 100 a displaying a conventionalspreadsheet application window 110 and a conventional web browserapplication window 120. On application windows 110 and 120, there arenumerous icons 102 that enable a user to initiate functions with apointing device (not shown). The user can simply direct a cursor 104 toa selected icon and engage the function it represents by depressing acontrol button on the pointing device one or more times. Applicationwindows 110 and 120 both include a familiar trio of icons in their upperright hand corners. These icons include minimize icons 112 and 122,maximize icons 114 and 124, and exit icons 116 and 126. Because of theclose proximity of these icons to each other, even skilled users may, onoccasion, inadvertently select and activate an undesired icon.

As shown in a screen 100 b of FIG. 1B, for example, the user hasselected exit icon 116 in spreadsheet application window 110. If theuser's selection was unintentional, all of the data entered inapplication window 110 might be lost, which the spreadsheet applicationwindow closes. To safeguard against such loss of data, once any new datahave been entered into application window 10, selection of exit icon 116conventionally often causes a confirmation dialog box 130 to bepresented to the user. Confirmation window 130 includes buttons enablinga user to confirm or retract a selection of exit icon 116 by selecting“yes” button 132 to exit after saving changes, “no” button 134 to exitwithout saving changes, or “cancel” button 136 to return to applicationwindow 110 without saving changes or exiting the application. A useraccidentally selecting exit icon 116 most likely would choose cancelbutton 136 to rescind the unintended action and thereby avoid theundesired loss of data changed (i.e., entered, edited, or deleted) sincethe spreadsheet was last saved.

However, not all applications provide such safeguards. For example, aweb browser, such as that shown by way of example in application window120, might enable a user to exit the web browser application byselecting exit icon 126 without requesting confirmation from the user.Accordingly, as shown in a screen 100 c of FIG. 1C, if a user movescursor 104 to exit icon 126 in application window 120 and select theexit icon, application window 120 will be closed without requiring thatuser confirm the apparent decision to exit the browser application.Thus, if a user should inadvertently select exit icon 126 of browserapplication window 120 in screen 100 c, the user might unexpectedly bepresented with a blank screen. If the user was in the middle of writinga lengthy e-mail using a web-based e-mail service or had found a desiredweb page after an exhaustive search, with one errant mouse click, theuser's work is lost. These types of problems can arise in almost anytype of graphic user interface environment in which a user may make anunintended selection and thereby invoke a function that produces anundesired result.

While requiring confirmation of each function selected by a user as isconventionally done might solve the problem of inadvertent selection ofa function by the user, it is simply not efficient to require that theuser confirm the selection of all functions. Usually, only functionsthat can produce serious consequences are selected for confirmation, buteven then, the user may tire of being required to confirm such aselection each time it is actually intended. Also, some functions, whichmay have less serious consequences, will simply add to the confusion andclutter of a graphic user interface display, if always visible to auser. Thus, it would be desirable to develop a different approach fordealing with these issues.

SUMMARY

As discussed in greater detail below, in regard to various embodiments,the present development facilitates an intuitive, user-friendly methodfor initiating a function on a computing device and helps to avoid theunintended execution of the function, while also reducing the visualclutter of a display that can occur when all functions that areavailable for selection by the user are always visually presented on thedisplay.

One aspect of this development is thus directed to a method forreceiving input in a computing device having a graphical user interfacepresented on a display. The method includes the step of identifying atleast one additional function of the computing device that is on atleast a portion of an underlying image. Initially, the function is notvisually apparent to a user and cannot be accessed because it is atleast partially obscured by a current image that is presented to theuser. The current image represents or is associated with a currentfunction. A predetermined user input can be applied to access theunderlying image. Upon receiving the predetermined user input, themethod provides for initiating a visual effect depicting the currentimage being at least partially removed from over the underlying image,to visually expose and enable access by the user to the at least oneadditional function, which was previously visually hidden by the currentimage. Because the additional function, which when executed, forexample, might cause the application currently running on the computingdevice to exit, is normally obscured or at least partially hidden, theuser is not likely to inadvertently select this additional function.

Another aspect of this development is directed to a memory medium onwhich are stored machine instructions for carrying out the steps thatare generally consistent with the method. A still further aspect isdirected to a system that enables functions generally consistent withthe steps of the method to be implemented.

This Summary has been provided to introduce a few concepts in asimplified form that are further described in detail below in theDescription. However, this Summary is not intended to identify key oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

DRAWINGS

Various aspects and attendant advantages of one or more exemplaryembodiments and modifications thereto will become more readilyappreciated as the same becomes better understood by reference to thefollowing detailed description, when taken in conjunction with theaccompanying drawings, wherein:

FIGS. 1A-1C (Prior Art) are graphical user interface screens throughwhich a user can inadvertently exit one or more applications (orinitiate other functions) by making an unintended control selectionusing a pointing device operated by the user;

FIGS. 2A-2B are interactive display surface screens that show how a usermight also inadvertently exit an application by inadvertently making aselection on the display screen with an external physical object such asa finger;

FIG. 3 is a functional block diagram of a generally conventionalcomputing device or personal computer (PC) that is suitable forimplementing an interactive display surface as used in a preferredembodiment for practicing the present invention;

FIG. 4A is a cross-sectional view of a table having an interactivedisplay surface, illustrating internal components of the table;

FIG. 4B is an isometric view of a table having an interactive displaysurface coupled with an external computing system;

FIG. 5 is an interactive display surface image of a music playerapplication including an embodiment of the present invention using apeel-back interface;

FIGS. 6A-6D, 7A-7B, and 8A-8B illustrate a user engaging a peel-backinterface presented by an interactive display surface and a functionsecured and/or concealed by the peel-back interface;

FIGS. 9A-9C, 10A-10B, 11A-11B, 12A-12B, 13A-13B, 14A-14B, and 15A-15B,and 16A-16B illustrate a user engaging alternative embodiments of thepresent invention presented by an interactive display surface;

FIGS. 17A-17B present an embodiment of the present invention adapted foruse with a pointing device-driven graphical user interface; and

FIG. 18 is a flow diagram illustrating the logical steps for respondingto user inputs through an interface according to an embodiment of thepresent invention.

DESCRIPTION

Figures and Disclosed Embodiments are not Limiting

Exemplary embodiments are illustrated in referenced Figures of thedrawings. It is intended that the embodiments and Figures disclosedherein are to be considered illustrative rather than restrictive.

Unintended Selection of an Exit Function on an Interactive DisplayScreen

In the Background section above, a problem arising in conventionalgraphic user interface display screens was discussed. However, a similarproblem might result when using an interactive display surface thatenables a user to employ physical external objects to interact with thedisplay surface. As shown in an example in FIG. 2A, an interactivedisplay 200 a is presenting an exemplary graphic user interface screenfor a music player application that enables a user to use physicalobjects, such as a finger 202, to build a play list 204 by selectingfrom album cover or similar icons 206 by bringing the finger in closeproximity to the desired icon.

Unfortunately, a user moving finger 202 over display surface 200 a mightinadvertently select an exit icon 208. Exit icon 208 is relatively closeto icons 206 and can be easily chosen when not intended. As shown in aninteractive display 200 b of FIG. 2B, by inadvertently dragging finger202 from a first position 202 a toward an edge of the interactivedisplay surface after, for example, filling playlist 204 with a numberof songs, finger 202 may contact exit icon 208. Unfortunately, in sodoing, after the user has spent time carefully selecting a number ofsongs for the playlist, the user might close the music player beforesaving the playlist, thus losing the songs that were selected andleaving a blank display.

Exemplary Computing System for Implementing Current Embodiments

With reference to FIG. 3, an exemplary system suitable for making use ofembodiments of the current development is shown. It will be appreciated,however, that this development is not limited to being practiced on thesystem of FIG. 3, but instead, can be carried out in connection withother computing devices. The system of FIG. 3 includes a general purposecomputing device in the form of a conventional personal computer (PC)320, provided with a processing unit 321, a system memory 322, and asystem bus 323. The system bus couples various system componentsincluding the system memory to processing unit 321 and may be any ofseveral types of bus structures, including a memory bus or memorycontroller, a peripheral bus, and a local bus using any of a variety ofbus architectures. The system memory includes read only memory (ROM) 324and random access memory (RAM) 325. A basic input/output system 326(BIOS), containing the basic routines that help to transfer informationbetween elements within the PC 320, such as during start up, is storedin ROM 324. PC 320 further includes a hard disk drive 327 for readingfrom and writing to a hard disk (not shown), a magnetic disk drive 328for reading from or writing to a removable magnetic disk 329, and anoptical disk drive 330 for reading from or writing to a removableoptical disk 331, such as a compact disk-read only memory (CD-ROM) orother optical media. Hard disk drive 327, magnetic disk drive 328, andoptical disk drive 330 are connected to system bus 323 by a hard diskdrive interface 332, a magnetic disk drive interface 333, and an opticaldisk drive interface 334, respectively. The drives and their associatedcomputer readable media provide nonvolatile storage of computer readablemachine instructions, data structures, program modules, and other datafor PC 320. Although the exemplary environment described herein employsa hard disk, removable magnetic disk 329, and removable optical disk331, it will be appreciated by those skilled in the art that other typesof computer readable media, which can store data and machineinstructions that are accessible by a computer, such as magneticcassettes, flash memory cards, digital video disks (DVDs), Bernoullicartridges, RAMs, ROMs, and the like, may also be used in the exemplaryoperating environment.

A number of program modules may be stored on the hard disk, removablemagnetic disk 329, removable optical disk 331, ROM 324, or RAM 325,including an operating system 335, one or more application programs 336,other program modules 337, and program data 338. A user may entercommands and information in PC 320 and provide control input throughinput devices, such as a keyboard 340 and a pointing device 342.Pointing device 342 may include a mouse, stylus, wireless remotecontrol, or other pointer, but in connection with the present invention,such conventional pointing devices may be omitted, since the user canemploy the interactive display for input and control. As usedhereinafter, the term “mouse” is intended to encompass virtually anypointing device that is useful for controlling the position of a cursoron the screen. Other input devices (not shown) may include a microphone,joystick, haptic joystick, yoke, foot pedals, game pad, satellite dish,scanner, or the like. Also, PC 320 may include a Bluetooth radio orother wireless interface for communication with various types ofinterface device, such as printers, or an embodiment of the interactivedisplay table, as discussed below. These and other input/output (I/O)devices are often connected to processing unit 321 through an I/O deviceinterface 346 that is coupled to the system bus 323. The term I/Ointerface is intended to encompass each interface specifically used fora serial port, a parallel port, a game port, a keyboard port, and/or auniversal serial bus (USB). System bus 323 is also connected to a camerainterface 359, which is coupled to an interactive display 360 to receivesignals form a digital video camera that is included therein, asdiscussed below. The digital video camera may be instead coupled to anappropriate serial I/O port, such as to a USB version 32.0 port. Anoptional monitor 347 can be connected to system bus 323 via anappropriate interface, such as a video adapter 348; however, theinteractive display table can provide a much richer display and enablethe user to interact with the system in a more intuitive manner forinput of information and control of software applications and cantherefore be coupled to the video adaptor in lieu of or in addition to aconventional monitor. It will be appreciated that PCs are often coupledto other peripheral output devices (not shown), such as speakers(through a sound card or other audio interface—not shown) and printers.

Embodiments of the present development may be practiced on a singlemachine, or on multiple computing devices. For example, PC 320 can alsooperate in a networked environment using logical connections to one ormore remote computers, such as a remote computer 349. Remote computer349 may be another PC, a server (which is typically generally configuredmuch like PC 320), a router, a network PC, a peer device, or a satelliteor other common network node, and typically includes many or all of theelements described above in connection with PC 320, although only anexternal memory storage device 350 has been illustrated in FIG. 3. Thelogical connections depicted in FIG. 3 include a local area network(LAN) 351 and a wide area network (WAN) 352. Such networkingenvironments are common in offices, enterprise wide computer networks,intranets, and the Internet.

When used in a LAN networking environment, PC 320 is connected to LAN351 through a network interface or adapter 353. When used in a WANnetworking environment, PC 320 typically includes a modem 354, or othermeans such as a cable modem, Digital Subscriber Line (DSL) interface, oran Integrated Service Digital Network (ISDN) interface for establishingcommunications over WAN 352, such as the Internet. Modem 354, which maybe internal or external, is connected to the system bus 323 or coupledto the bus via I/O device interface 346, i.e., through a serial port. Ina networked environment, program modules, or portions thereof, used byPC 320 may be stored in the remote memory storage device. It will beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused, such as wireless communication and wide band network links.

Exemplary Interactive Display Table with Interactive Display Surface

In FIG. 4A, an exemplary interactive display table 460 is shown thatincludes PC 420 within a frame 462 and which serves as both an opticalinput and video display device for the PC. This exemplary embodiment isnot intended to in any way be viewed as limiting on the claims thatfollow, since it is only one example of a display surface useful inconnection with practicing the present development. In this cut-awayfigure of interactive display table 460, rays of light used fordisplaying text and graphic images are generally illustrated usingdotted lines 482 a-82 c, while rays of IR light used for sensing objectson or just above a display surface 464 a of interactive display table460 are illustrated using dashed lines 480 a-80 b. Display surface 464 ais set within an upper surface 464 of interactive display table 460. Theperimeter of the table surface is useful for supporting a user's arms orother objects, including objects that may be used to interact with thegraphic images or virtual environment being displayed on display surface464 a.

IR light sources 466 preferably comprise a plurality of IR lightemitting diodes (LEDs) and are mounted on the interior side of frame 462in this exemplary embodiment, but can alternatively be mounted at otherlocations on the interactive display table. The IR light that isproduced by IR light sources 466 is directed upwardly toward theunderside of display surface 464 a, as indicated by dashed lines 478 a,478 b, and 478 c. The IR light from IR light sources 466 is reflectedfrom any objects that are atop or proximate to the display surface afterpassing through a translucent layer 464 b of the table, comprising asheet of vellum or other suitable translucent material with lightdiffusing properties. As used herein and in the claims that follow inconnection with objects positioned on or proximate to the interactivedisplay surface, the term “adjacent to” is used with the intention thatthis term encompass both an object that is actually touching theinteractive display surface as well as one that is just above but notnecessarily touching the interactive display surface. Although only oneIR light source 466 is shown, it will be appreciated that a plurality ofsuch IR light sources may be mounted at spaced-apart locations aroundthe interior sides of frame 462 to provide an even illumination ofdisplay surface 464 a. The IR light produced by the IR light sourcesmay:

-   -   exit through the table surface without illuminating any objects,        as indicated by dash line 478 a;    -   illuminate objects on the table surface, as indicated by dash        line 478 b; or    -   illuminate objects disposed a short distance above the table        surface but not touching the table surface, as indicated by dash        line 478 c.

By way of example, objects above display surface 464 a can include a“touch” object 476 a that rests atop the display surface and/or a“hover” object 476 b that is close to but not in actual contact with thedisplay surface. Thus, both touch and hover objects are “adjacent to”the display surface, as that term is used herein. As a result of usingtranslucent layer 464 b under the display surface to diffuse the IRlight passing through the display surface, as an object approaches thetop of display surface 464 a, the amount of IR light that is reflectedby the object increases to a maximum level that is achieved when theobject is actually in contact with the display surface.

A digital video camera 468 is mounted to frame 462 below display surface464 a in a position appropriate to receive IR light that is reflectedfrom any touch object or hover object disposed above display surface 464a. Digital video camera 468 is equipped with an IR pass filter 486 athat transmits only IR light and blocks ambient visible light travelingthrough display surface 464 a along dash-dot line 484 a. A baffle 479 isdisposed between IR light source 466 and the digital video camera toprevent IR light that is directly emitted from IR light source 466 fromentering the digital video camera, since it is preferable that thisdigital video camera should produce an output signal that is onlyresponsive to the IR light reflected from objects that are a shortdistance above or in contact with display surface 464 a and correspondsto an image of IR light reflected from objects on or above the displaysurface. It will be apparent that digital video camera 468 will alsorespond to any IR light included in the ambient light that passesthrough display surface 464 a from above and into the interior of theinteractive display including ambient IR light that also travels alongthe path indicated by dash-dot line 484 a.

IR light reflected from objects on or above the table surface may be:

-   -   reflected back through translucent layer 464 b, through IR pass        filter 486 a and into the lens of digital video camera 468, as        indicated by dashed lines 480 a and 480 b; or    -   reflected or absorbed by other interior surfaces within the        interactive display without entering the lens of digital video        camera 468, as indicated by dashed line 480 c.

Translucent layer 464 b diffuses both incident and reflected IR light.Thus, as explained above, “hover” objects such as hover object 476 bthat are closer to display surface 464 a will reflect more IR light backto digital video camera 468 than objects of the same reflectivity thatare farther away from the display surface. The digital video camera 468senses the IR light reflected from “touch” and “hover” objects withinits imaging field and produces a digital signal corresponding to imagesof the reflected IR light that is input to the PC 420 for processing todetermine a location of each such object, and optionally, the size,orientation, and shape of the object. It should be noted that a portionof an object, such as a user's forearm, may be above the table whileanother portion, such as the user's finger, is in contact with thedisplay surface. In addition, an object may include an IR lightreflective pattern or coded identifier, such as a bar code, on itsbottom surface that is specific to that object or to a class of relatedobjects of which that object is a member. Accordingly, the imagingsignal from the digital video camera 468 can also be used for detectingeach such specific object, as well as determining its orientation, basedon the IR light reflected from its reflective pattern, in accord withthe present invention.

Embodiments of the present invention are thus operable in connectionwith selection and control of an application by recognizing an objectand/or its position relative to the interactive display surface 464 a bydetecting its identifying characteristics using the IR light reflectedfrom the object. For example, the undersurface of an object may includean encoded marking that enable each different object to be readilyrecognized when the object is positioned adjacent to the display surfaceso that IR light reflected/absorbed by the encoded markings is detectedby digital video camera 468. Shape, size, and combinations of these andother physical parameters can also be sensed in regard to the IR lightreflected/absorbed by an object to enable the object and its position(and/or orientation) to be recognized by the digital video camera.

PC 420 may be integral to interactive display table 460 as shown in FIG.4A, or alternatively, may instead be external to the interactive displaytable, as shown in the embodiment of FIG. 4B. In FIG. 4B, an interactivedisplay table 460′ is connected through a data cable 463 to an externalPC 420 (which includes optional monitor 447, as mentioned above).Alternatively, external PC 420 can be connected to interactive displaytable 460′ via a wireless link (i.e., WiFi or other appropriate radiosignal link). As also shown in this Figure, a set of orthogonal X and Yaxes are associated with display surface 464 a, as well as an originindicated by “0”. While not discretely shown, it will be appreciatedthat a plurality of coordinate locations along each orthogonal axis canbe employed to specify any location on display surface 464 a.

If an interactive display table 460′ is connected to an external PC 420(as in FIG. 4B) or to some other type of external computing device, suchas a set top box, video game, laptop computer, or media computer (notshown), then interactive display table 460′ comprises an input/outputdevice. Power for interactive display table 460′ is provided through apower lead 461, which is coupled to a conventional alternating current(AC) source (not shown). Data cable 463, which connects to interactivedisplay table 460′, can be coupled to a USB 2.0 port, an Institute ofElectrical and Electronics Engineers (IEEE) 1394 (or Firewire) port, oran Ethernet port on PC 420. It is also contemplated that as the speed ofwireless connections continues to improve, interactive display table460′ might also be connected to a computing device, such as PC 420 viasuch a high-speed wireless connection, or via some other appropriatewired or wireless data communication link. Whether included internallyas an integral part of the interactive display, or externally, PC 420executes algorithms for processing the digital images from digital videocamera 468 and executes software applications that are designed toemploy the more intuitive user interface functionality of theinteractive display table to good advantage, as well as executing othersoftware applications that are not specifically designed to make use ofsuch functionality, but can still make good use of the input and outputcapability of the interactive display table. As yet a furtheralternative, the interactive display can be coupled to an externalcomputing device, but include an internal computing device for doingimage processing an other tasks that then need not be done by theexternal PC.

An important and powerful feature of interactive display table 460 or460′ (i.e., of either of the embodiments of the interactive displaytable discussed above) is its ability to display graphic images or avirtual environment for games or other software applications and toenable an interaction between the graphic image or virtual environmentvisible on display surface 464 a and identify objects that are restingatop the display surface, such as object 476 a, or are hovering justabove it, such as object 476 b.

Again referring to FIG. 4A, interactive display table 460 includes avideo projector 470 that is used to display graphic images, a virtualenvironment, or text information on display surface 464 a The videoprojector is preferably of a liquid crystal display (LCD) or digitallight processor (DLP) type, or a liquid crystal on silicon (LCoS)display type, with a resolution of at least 640×480 pixels. An IR cutfilter 486 b is mounted in front of the projector lens of videoprojector 470 to prevent IR light emitted by the video projector fromentering the interior of the interactive display table where the IRlight might interfere with the IR light reflected from object(s) on orabove display surface 464 a Video projector 470 projects light alongdotted line 482 a toward a first mirror assembly 472 a First mirrorassembly 472 a reflects projected light from dotted, line 482 a receivedfrom video projector 470 along dotted line 482 b through a transparentopening 490 a in frame 462, so that the reflected projected light isincident on a second mirror assembly 472 b. Second mirror assembly 472 breflects light from dotted line 482 b along dotted line 482 c ontotranslucent layer 464 b, which is at the focal point of the projectorlens, so that the projected image is visible and in focus on displaysurface 464 a for viewing.

Alignment devices 474 a and 474 b are provided and include threaded rodsand rotatable adjustment nuts 474 c for adjusting the angles of thefirst and second mirror assemblies to ensure that the image projectedonto the display surface is aligned with the display surface. Inaddition to directing the projected image in a desired direction, theuse of these two mirror assemblies provides a longer path betweenprojector 470 and translucent layer 464 b to enable a longer focallength (and lower cost) projector lens to be used with the projector.

The foregoing and following discussions describe an interactive displaydevice, of which interactive display table 460 and 460′ are simplyexemplary. However, other display surfaces can be employed instead. Forexample, it should be understood that the interactive display surfaceneed not be in the form of a generally horizontal table top. Theprinciples described in the following description are also applicable todisplay surfaces of different shapes and curvatures and that are mountedin orientations other than horizontal and which employ other techniquesfor sensing an object relative to a displayed image. Although thefollowing description at times refers to placing physical objects “on”the interactive display surface, physical objects may be placed adjacentto the interactive display surface by placing the physical objects incontact with the display surface, or otherwise adjacent to the displaysurface.

Exemplary Application Employing One Embodiment

FIG. 5 shows a screen 500 a from an interactive display surfacepresenting a music player application similar to that described inconnection with FIGS. 2A-2B. Again, by using a physical object such asuser's hand 502, a user can build a playlist 504 by touching orotherwise selecting icons 506 that represent one or more musicalselections. In contrast to the music player application depicted inFIGS. 2A-2B, however, screen 500 a does not include an exit icon 208that is always visible on screen 500 a. Instead, in this exemplaryembodiment, a user accesses an exit icon by engaging a “peel-backinterface” 510 at the lower right corner of the displayed user interfacescreen.

FIGS. 6A-6D depict this exemplary embodiment in use. FIG. 6A illustratesa corner 600 of screen 500 a, showing an enlarged version of peel-backinterface 510. To engage peel-back interface 510, in this exemplaryembodiment, a user employs a physical object, such as the user's finger,which is shown at a first position 602 a, to engage an access portion604. Access portion 604, in this exemplary embodiment of the presentinvention, is graphically depicted as a flap as the flap would appear ifphysically, a corner 600 of the image of screen 500 a as presented onthe display were peeled back. In one embodiment, access portion 604overlies a secondary interface area 606 before the access portion is“peeled back.” In the example shown in FIG. 6A, secondary interface area606 foreshadows a possibility that additional content is includedbeneath the flap of access portion 604, just as, by analogy, a looseflap of a top layer of wallpaper might foreshadow a previous wallcovering under the top layer of wallpaper. Further, just as peeling backa loose corner of the top layer of wallpaper provides access to the wallcovering that is covered by the top layer, manipulating access portion604 allows a user further access to secondary interface area 606. Asshown in FIG. 6A, a user engages access portion 604 by touching accessportion 604 with the user's finger, although another external object, ora pointing device-controlled cursor could be used instead for thispurpose.

Having touched access portion 604, FIG. 6B shows corner 600 of thescreen and movement of the user's finger from first position 602 a, asshown in FIG. 6A, in the direction of arrow 610, to a second position602 b, causing the corner flap to be folded back further so that more ofsecondary interface area 606 is visible, and so part of an exit icon 612is exposed. FIG. 6C shows corner 600 after the user's finger hascontinued moving inwardly of the displayed screen to a third position602 c, making still more of secondary interface area 606 visible tofully display exit icon 612, which had originally been hidden by theoverlying display screen. Finally, FIG. 6D shows corner 600,illustrating how, while maintaining third position 602 c to continuefully revealing the exit icon, the user engages now fully exposed exiticon 612 with another external physical object, such as a finger 614 onthe user's other hand. The combined movements depicted in FIGS. 6A-6Denable user to first make the exit icon visible, and then select theexit icon to exit the application.

Three concepts should be appreciated from FIGS. 6A-6D. First, thepeel-back interface illustrated prevents the user from accidentallyexiting the application because the exit icon must be made visiblebefore it can be selected and activated by the user. Thus, the exemplaryembodiment operates much like a safety switch on a piece of equipmentthat must first be engaged before another switch can be used to activatethe equipment. In this manner, potentially “destructive” functions suchas an exit function, or other functions with potentially undesiredconsequences can be secured from inadvertent activation.

Second, because exit icon 612 was concealed by the overlying flaprepresenting access portion 604 (see FIG. 6A), there is at least oneless icon that must be fit onto the originally presented display screen.Certain functions that need not always be made visible in a graphicsuser interface can be kept hidden until the user takes a proactiveaction (e.g., peeling back the overlying corner flap) to make thosefunctions visible for selection. As a result, the normally visibledisplay screen can be made much less cluttered.

Third, in contrast to conventional confirmation dialog box 130 of FIG.1B, if a user performs the necessary actions to expose the exit icon (orsome other icon or control to initiate a function), the user need notwait for the confirming dialog and perform a second operation to closethe application. Thus, in this example, if a user truly wishes to exitan application and manifests this intention by performing steps that arenot likely to occur as a result of an inadvertent movement, the user cando so by causing the obscuring overlying displayed surface to be removeto reveal the underlying exit icon or control and then selecting theicon or control to exit the application.

Exemplary Variations of the Peel-Back Interface

This interface is not limited to serial actions that first expose andthen activate an icon or control in the secondary interface area. Forexample, FIG. 7A shows an enlarged corner 700 of a screen where theuser's finger has been moved to a first position 702 a and thereby drawn(i.e., peeled back) access portion 704 across the screen to make visiblesecondary interface area 706 and fully expose an exit icon 712. However,in this/embodiment, the user need not use a second external physicalobject to selectively activate exit icon 712. As shown in FIG. 7B,peeling back access portion 704 expose underlying secondary interfacearea 706 triggers a predefined time interval during which secondaryinterface area 706 remains visible, even if the user's finger is liftedfrom the first position 702 a. As a result, the user can move the samefinger to a position 702 b to activate exit icon 712, for example, andthus exit the current application that is producing the current displayscreen. Like the embodiment of FIGS. 6A-6D, although the object used topeel back access portion 704 can be a single finger or other externalobject, the series of actions performed with the finger or objectprovides security against unintended activation of the functionsrepresented by the one or more icons functions in the secondaryinterface area.

Embodiments are thus not limited to a secondary interface area havingonly a single icon, control, or function, or only to an exit function orother potentially dangerous functions. For example, FIG. 8A shows anenlarged view of a corner 800 peeled back from a secondary interfacearea 806, where the selection made with the user's finger, which is nowat a first position 802 a, has revealed and fully exposed an exit icon812 that can be used to exit the current application. However, as shownin FIG. 8B, further movement of the user's finger to a second position802 b has revealed more of secondary interface area 806 b. Secondaryinterface area 806 b, in addition to exit icon 812, includes twoadditional icons 814 and 816 that are now fully revealed and visible.Thus, the exemplary peel back interface may be controlled to selectivelyreveal one, or successive additional previously concealed icons,controls, or functions.

User Selectable Invocation and Disposition of a Peel-Back Interface

This interface is not limited to concealing functions at a corner of adisplay. Embodiments of the present invention can present flaps that canbe removed to provide visible access to a secondary interface area alongan edge of a screen, or at any point of the screen. Furthermore, peelback interfaces can optionally also be invoked by a user on demand,and/or at a location of the user's choosing.

FIG. 9A shows an exemplary screen 900 presented by an interactivedisplay interface. On screen 900, a user has placed one finger in aposition 902 a along an edge 903 of the current display screen. There isno flap or other indication of that action being able to provide accessto a secondary interface area. However, by a predetermined movement orgesture, such as placing a finger or hand in an otherwise unused area ofthe display screen, or placing a finger or hand within a certaindistance from any edge of the display screen, or placing a finger orhand on the display screen and leaving it in that position for at leasta predetermined time interval, or tapping a finger or hand on thedisplay screen a predetermined number of times, or by some otherpredetermined movement or gesture, an access portion to a secondaryinterface area can be generated by the user at the position where themovement or gesture is made, or at a predefined portion of the displayscreen.

FIG. 9B shows a screen 900 with user's finger still in first position902 a. However, by perhaps tapping screen 900, holding user's hand in afirst position 902 a for a predefined time interval, or performing someother gesture, access portion 904 is peel back and secondary interfacearea 906 a made to appear alongside edge 903 of display 900. Then, asshown in FIG. 9C, upon moving the finger (or the coded object) to asecond position 902 c away from edge 903 of screen 900 c, a largersecondary interface area 906 c is presented to the user. Secondaryinterface area 906 c includes one or more icons 912 representingfunctions that are otherwise secured and/or concealed from the user bythe overlying screen currently being displays in FIG. 9A. Icons 912 arethus made visible and accessible for selection wherever the user mightlike to have them appear by exposing them on the secondary interfacearea. The secondary interface area and the icons can be made visibleanywhere on the screen according to the user's preference orconvenience.

Instead of the user selectively invoking access portion 904 (FIG. 9B) toreveal and make visible secondary interface area 906 by performing apredetermined movement or gesture, an access position also could beselectively invoked by placing a physical object adjacent to theinteractive display surface. A physical object may present anidentifiable shape or an optical code recognizable by the interactivedisplay surface and associated with making visible the secondaryinterface area. In one embodiment of the invention, the physical objectmight have a form or carry a marking that also readily enables the userto identify its function in removing the portion of the current image onthe display screen that is hiding the secondary interface area.

For example, as shown in the example of FIG. 10A, a physical object suchas a knife-shaped object, which may be intuitively associated by a userwith its use in piercing or cutting through current overlying image toreveal the underlying secondary interface area and thus enable the useraccess to functions or controls on the secondary interface area. A shownby a screen 1000 in FIG. 10A, when the knife-shaped object is placed ina first position 1002 a adjacent to the interactive display surface,e.g., near an edge 1003 of screen 1000, access position 1004 ispresented adjacent to a secondary interface area 1006. FIG. 10B showsthat, as the knife-shaped physical object is moved in the direction ofan arrow 1008, to a second position 1002 b, it appears that the imagecurrently being displayed by the active application is “cut away” toreveal more of secondary interface area 1006, presenting a plurality ofexposed icons 1012 having functions that the user can now select andinitiate. Exposed icons 1012 are activated by selecting them with theknife-shaped physical object (or with some other object) as describedabove.

Alternative Presentations of Secondary Interface Areas

FIGS. 4A-4B, 5, 6A-6B, 7A-7B, 8A-8B, 9A-9C, and 10A-10B all depict formsof a peel-back interface in which a corner, either at a corner of adisplay or appearing at an edge or at another point on the screen, ispeeled (or cut away) to reveal a secondary interface area. However,embodiments of the interface are not limited to secondary interfaceareas that appear only in corners or as corners.

FIGS. 11A-11B show an embodiment of the interface where a secondaryinterface area is made visible and accessible by a “slideover” removalof the current image to expose the underlying secondary interface area.Screen 1100 of FIG. 11A shows an external physical object, in this casea user's hand, placed at a first position 1102 a over an applicationscreen 1104 a. To access the underlying secondary interface area, theuser slides the hand across the interface display surface as shown inFIG. 11B. As shown therein, when the user's hand is moved from a firstposition 1102 a to a second position 1102 b, application screen 1104 ispartially slid “off” the display surface, i.e., so that the part of theapplication now slid beyond the edge of the display screen is no longervisible. Appearing in an area previously covered by application screen1104 is secondary interface area 1106. By sliding the user's hand acrossthe interactive screen, secondary interface area 1106 has been exposedso that it now visible and access is provided to a plurality of icons1108.

In such an embodiment, the interactive display surface is configured todistinguish another sliding- or dragging-type command from an attempt toinvoke the secondary interface area. For example, the action of a userattempting to access the secondary interface area can be based upon theinteractive display surface recognizing the disposition of a physicalobject that spans more than a predetermined area and detecting that thephysical object is being slid across the interactive display surface.Alternatively, and as described above, a user may signal an intention toaccess the secondary interface area by performing a particular gesturewith the user's hand or finger(s), such as by tapping the user's fingeron the interactive display surface, or by holding the finger or hand inone position adjacent the interactive display surface for at least apredetermined interval of time before sliding the hand across theinteractive display surface.

FIGS. 12A-12B show another embodiment of the interface where a secondaryinterface area is accessible using a “pull apart” technique. Screen 1200of FIG. 12A shows two physical objects, in this case both of the user'shands, placed at first positions 1202 a and 1203 a over a currentlydisplayed application screen 1204 a. To access a secondary interfacearea, the user pulls these two hands apart from each other by slidingone or both across the interface display surface, as shown in FIG. 12B.When the user's hands are moved from first positions 1202 a and 1203 ato second positions 1202 b and 1203 b, respectively, a gap is formedwithin currently displayed application screen 1204. Appearing in thisgap is a secondary interface area 1206. In one embodiment, secondaryinterface area 1206 is bordered by flaps 1208 to reinforce and enhancethe “pull apart” visual effect. Once revealed, secondary interface area1206 presents a plurality of previously concealed icons 1210, orcontrols, or functions.

FIGS. 13A-13B show another embodiment of the interface where a secondaryinterface area is accessible through a “crumpling” visual effect. Ascreen 1300 in FIG. 13A shows a user's hand placed in a flat, fingersextended-configuration 1302 a over a currently displayed applicationscreen 1304. To access a secondary interface area 1306, the usersqueezes the hand into a “crumpled” configuration 1302 b over theinterface display surface as shown in FIG. 13B. As shown, when theuser's hand is the crumpled configuration, application screen 1304 b isreduced in size, drawing back or contracting from one side or all foursides of the interactive display surface (as shown in FIG. 13B).Appearing around contracted application screen 1304 b and visible issecondary interface area 1306. In such an embodiment, the interactivedisplay surface is configured to recognize the crumpling motion of theuser's hand, for example, by recognizing the reduction in the areaoccupied by the hand as it is configured with the fingers forming afist.

As shown in FIG. 13B, a trio of icons, including minimize icon 1308 a,window sizing icon 1308 b, and exit icon 1308 c are now visible andaccessible by the user within secondary interface area 1306. Icons 1308a, 1308 b, and 1308 c similarly have been presented in the secondaryinterface area, in other embodiments discussed above. However, inaddition to icons 1308 a, 1308 b, and 1308 c, secondary interface area1306 also provides access to a number of functions specific to theapplication presented by application screen 1304 b. Thus, in thisexample, the normal or current display of a music player applicationpresented by application screen 1304 b is made less visually crowded bydisposing volume control icon 1310 a and player control icons 1310 b,including stop, play, pause, etc., within secondary interface area 1306.

Also, in this exemplary embodiment, as in other embodiments, the usercan selectively engage any of the functions represented by icons 1308a-1308 c and 1310 a and 1310 b by holding the hand in crumpled position1302 b while selecting one of the icons with a finger on the oppositehand or with another external physical object. Alternatively, theinteractive display surface can maintain application window 1304 b in acontracted size for a predetermined interval, enabling the user toselect one of the icons with the same hand.

FIGS. 14A-14B show an embodiment where a secondary interface area 1406is accessible via a “cut-through” visible effect. Screen 1400 of FIG.14A shows a physical object, in this case the knife-shaped object,placed at a first position 1402 a over an application screen 1404. Theknife-shaped object is once again chosen because it appropriatelysignifies how the physical object will interact with the current imageon interactive display surface to provide access to the secondaryinterface area. As shown in FIG. 14B, to access a secondary interfacearea, the user slides the physical object across the interface displaysurface to a second position 1402 b. Sliding the physical object tosecond position 1402 b causes an opening to form in the currentdisplayed image, exposing underlying secondary interface area 1406.Secondary interface area 1406 is bounded by virtual flaps 1408, whichreinforce the intended cut-through nature of the visual effect. Thesecondary interface area 1406 once again includes a plurality of icons1410 the user can selectively activate to initiate any of the functionsassociated with these previously concealed icons. Although the exampleof FIGS. 14A-14B uses a knife-shaped physical object, it will beappreciated that any other suitable physical object having a shape orcoding recognizable by the interactive display surface may be used.Similarly, embodiments where such a physical object is used are notlimited to visualizing the access to the secondary interface area bysimulating cutting through an application screen, but can employ othertypes of visual effects.

Secondary Interface Areas Including Additional Application Screens

As illustrated in a number of the embodiments discussed above, thesecondary interface area may be accessed by a predetermined action ofthe user to gain access to one or more icons or controls representingfunctions desirably removed from the current application screen.However, embodiments of the interface enabling the user to access asecondary interface area to use functions that are available therein arenot limited to providing access to a range of functions associated withthe application currently presented on the display. Instead, thisinterface is also usable to enable a user to access a wide range offunctions not necessarily related to the current application including,for example, functions in another application that is being executed, orcontrols that enable execution of another application to be started.

FIG. 15A-15B show an embodiment of the interface where a secondaryinterface area is for a different application. Using a “slide-over”visual effect, as described in connection with FIGS. 11A-11B, a userplaces a physical object, such as the user's hand, in a first position1502 a over application screen 1504 of a screen 1500. Then, as shown inFIG. 15B, the user's hand is moved to a second position 1502 b which, asshown in the Figure, extends at least partially off screen 1500. Movingthe user's hand to second position 1502 b drags first application screen1504 off the screen, exposing secondary display area 1506 in which adifferent application is running. Access to this different application,that was previously overlaid by application screen 1504, is nowavailable. In this manner, instead of entering a combination ofkeystrokes, selecting a system button, or performing some other actionused in conventional interfaces to access a different runningapplication, the user can access another running application (or theicons, controls, and/or other functions of the other application) by ineffect, simply sliding one application at least partially off of thevisual workspace, to make the other application visible.

It should be appreciated that changing to another application in thismanner may be triggered by using a physical object having a specificshape or coding that is recognized by the interactive display surface,to slide the current application screen over and at least partially offthe display. Alternatively, as compared to the exemplary embodiment ofFIGS. 11A-11B, accessing a secondary interface area to enable selectiveuser access to functions for the current application, rather thanexposing another running application may be differentiated by thedistance that the user-slides the physical object to move the currentdisplay screen. As a further alternative, applying the flat of user'shand or just the fingertips may determine whether hidden functions for acurrent display screen or a different application are made visible bysliding the user's hand across the interactive display screen.

It also should be appreciated that a variety of graphical effects can beused to signal access to the secondary interface area to confirm theuser's choice, as well as entertain the user, as exemplified in FIGS.16A-16B. Screen 1600 a of FIG. 16A shows a user placing a physicalobject, in this case the user's hand, at a first position 1602 a onapplication screen 1604. As shown by a screen 1600 b on FIG. 16B, whenthe user's hand is moved to a second position 1602 b and secondaryinterface area 1606 representing another application moves onto screen1600 b, application screen 1604 “crumples” as represented by a number offold lines 1610.

Embodiments that do not Require an Interactive Display Surface

The embodiments discussed above illustrate the use of the interface inconnection with an interactive display surface. However, embodiments ofthe interface can also be controlled by keyboards and/or pointingdevices. Screen 1700 a of FIG. 17A shows a spreadsheet application 1704using one such embodiment. Compared to the conventional spreadsheetapplication illustrated in FIG. 1A, spreadsheet application 1704 doesnot visibly display a number of menu options and icons across the top ofthe display screen. Thus, the interface for spreadsheet application 1704appears much less cluttered and enables a user to view more cells at onetime (for the same resolution and window size) than a conventionalspreadsheet application. However, to still provide the functionality andusefullness of the conventional spreadsheet application of FIG. 1A, themenus and icons are not removed, but are merely concealed. A flap 1706is displayed in an upper right corner of spreadsheet application 1704.Flap 1706 represents an access position that the user can selectivelyengage with a cursor 1708.

As shown by screen 1700 b of FIG. 17B, the user accesses the secondaryinterface area 1710 by selecting flap 1706 representing the accessposition with cursor 1708 and then dragging the flap 1706 downwardly.Secondary interface area 1710 includes familiar menus and commands 1712,and icons 1714 to facilitate the normal functionality of spreadsheetapplication 1704. In one embodiment, secondary interface area 1710remains present until user again selects flap 1706 with cursor 1710and/or drags flap 1706 back to its original position. Alternatively,after the user selects one item in the secondary interface area forcarrying out a function, the secondary interface area can automaticallyclose.

Steps for Accessing Functions Presented by a Secondary Interface Area

FIG. 18 shows a generalized flow diagram 1800 illustrating logical stepsfor by which a user accesses functions presented by a secondaryinterface area. In the example of FIG. 18, the interface is described asa “peel-back” interface, but it will be appreciated that the logicalsteps of flow diagram 1800 are for other embodiments of the userinterface providing access to additional functions on a secondaryinterface area and do not require use of an interactive display surface.

Flow diagram 1800 begins at a start step 1802. At a decision step 1804,it is determined if a potential peel-back user interface input has beendetected. If not, flow diagram 1800 loops back to decision step 1804until such a user input is detected. Once it is determined at decisionstep 1804 that such a user input has been detected, at a decision step1806, it is determined if the input has been made in a designated userinterface area. As described above, such an interface may be designatedby a flap presented on the display, may be limited to corners or edgesof the screen, or a user may be able to initiate access to the secondaryinterface area anywhere on the screen by performing a predeterminedgesture or using a particular physical object recognized by the system.If it is determined at decision step 1806 that such an input has beenmade in a designated user input area, at a step 1808, an animation orvisual effect associated with accessing the secondary interface area atthe designated area is performed. For example, a predetermined input maycause a flap to be peeled down, a primary display area to be split open,crumpled, or slid across the screen, as described above. Alternatively,if it was determined at decision step 1806 that no input in a designateduser interface area was detected, at a decision step 1810, it isdetermined if an input has been received by detecting an encoded objectused for a peel back user interface. In other words, even if anapplication may detect and respond to a physical object only indesignated portions of the interface, an input may be made usingspecially shaped or encoded object anywhere on the display surface, aschosen by the user. If it is determined at decision step 1810 that sucha specially encoded object has been detected, at a step 1812, ananimation associated with detection of the encoded object is performed.On the other hand, if at decision step 1806 it was determined that noinput was detected in a designated user interface area, and that indecision step 1810, it was determined that no specially encoded physicalobject was presented, flow diagram 1800 loops to decision step 1804 toawait detection of the next potential user interface input.

If the user input was detected in an appropriate user input area, orsuch an input made with a specially encoded physical object was detectedin decision step 1810, at a step 1814, a secondary interface area ispresented to enable access to previously concealed functions. At adecision step 1816, it is determined if one of the functions has beenproperly selected. If not, according to one embodiment of the presentinvention, the secondary interface area is concealed once more, and flowdiagram 1800 loops to decision step 1804 to await the next related userinput. On the other hand, if it is determined at decision step 1816 thatthe function was properly selected, at a step 1818, the operationassociated with the function is performed.

Once the selected function is performed at step 1818, at a decision step1820, it is determined if the selected function served to end theprogram. If so, the program, as well as flow diagram 1800, ends at astep 1822. On the other hand, if it is determined at decision step 1820that the selected function does not end the program, flow diagram 1800loops to decision step 1804 to await the next related user input.

Although the present invention has been described in connection with thepreferred form of practicing it and modifications thereto, those ofordinary skill in the art will understand that many other modificationscan be made to the present invention within the scope of the claims thatfollow. Accordingly, it is not intended that the scope of the inventionin any way be limited by the above description, but instead bedetermined entirely by reference to the claims that follow.

1. A method for receiving input in a computing device having a graphicaluser interface to access functions related to a displayed window butwhich are obscured and on an underlying image, the method comprising thesteps of: (a) identifying at least one additional function of anapplication window displayed on the graphical user interface of thecomputing device, the at least one additional function being accessibleon at least a portion of an underlying image that is not currentlyvisible to a user, wherein the at least one additional function isinaccessible from a current image of the application window and relatesdirectly to manipulation of the current image; (b) presenting thecurrent image to the user, the current image representing a currentfunction of the application and covering at least a portion of theunderlying image such that access to the at least one additionalfunction is at least partially covered by the current image renderingthe at least one additional function inaccessible from the currentimage; (c) establishing a predetermined user input for providing accessto the underlying image and the function accessible thereon; and (d)upon receiving the predetermined user input from the user, initiating avisual effect depicting the current image representing the currentfunction of the application being at least partially removed from overthe underlying image to visually expose and enable access by the user tothe at least one additional function of the application, which waspreviously visually hidden by the current image, wherein steps (a)-(d)are performed on an interactive display table configured to recognizedifferent objects and perform different visual effects to the currentimage based on which of the different objects is used to perform thepredetermined user input, as well as to perform different visual effectsfor different predetermined user inputs; wherein the current image doesnot include immediately visible functions for at least two of: (A)minimizing the current image; (B) maximizing the current image; and (C)closing the current image; and wherein initiating a visual effectdepicting the current image representing the current function of theapplication being at least partially removed from over the underlyingimage to visually expose and enable access by the user to the at leastone additional function of the application includes crumpling at least aportion of the current image and thereby exposing the at least twofunctions not immediately visible on the current image.
 2. The method ofclaim 1, wherein the underlying image includes at least one of: (a) anexit function for the current function represented by the current image;or (b) at least one additional menu associated with the applicationdisplayed on the current image including a plurality of additionalfunctions not accessible via the current image.
 3. The method of claim1, wherein the display includes an input responsive display and thepredetermined input includes positioning an external object adjacent tothe input responsive display to interact with the current image, whereinadjacent includes objects that are near, but not actually touching theinput responsive display.
 4. The method of claim 3, further comprisingthe step of at least one of: (a) responding to the user positioning theexternal object adjacent to a predetermined area of the current image onthe input responsive display; (b) responding to the user positioning theexternal object adjacent to the predetermined area of the inputresponsive display and lifting the external object away from the inputresponsive display; (c) responding to the user positioning the externalobject adjacent to a predetermined portion of the input responsivedisplay; (d) responding to the user positioning the external objectadjacent to a designated portion of the current image on the inputresponsive display and lifting the external object away from the inputresponsive display; or (e) responding to the user performing apredetermined gesture with the external object adjacent to the inputresponsive display, including one of: (i) placing the external objectadjacent to a corner of a predetermined area of the input responsivedisplay, and moving the external object away from the corner of thepredetermined area; (ii) placing the external object adjacent to an edgeof a predetermined area of the input responsive display, and moving theexternal object away from the edge of the predetermined area; (iii)placing the external object adjacent to a corner of the current image,and moving the external object away from the corner of the currentimage; (iv) placing the external object adjacent to an edge of thecurrent image, and moving the object away from the edge of the currentimage; (v) placing a plurality of external objects adjacent to the inputresponsive display and moving the plurality of external objects apartfrom each other; (vi) placing the external object adjacent to a surfaceof the input responsive display and moving the external object toward anedge of the input responsive display; or (vii) placing the externalobject adjacent to a surface of the input responsive display and movingat least a portion of the external object in a direction generallyparallel with the surface of the input responsive display.
 5. The methodof claim 3, wherein the external object includes at least one of: (a)multiple portions of a user's hand; (b) a user manipulatable object,wherein the object has a shape that is recognized by the inputresponsive display; or (c) a user manipulatable object, wherein theobject is coded to be recognized by the input responsive display.
 6. Themethod of claim 5, wherein the external object is configured to berecognized by the input responsive display as being associated withproviding access to the underlying image, and access is provided to theunderlying image upon the configuration of the external object beingrecognized by the input responsive display.
 7. The method of claim 5,wherein the user manipulatable object is a knife-shaped physical objecthaving a blade portion.
 8. The method of claim 1, wherein thepredetermined action includes manipulating a pointing device to aposition on the display and dragging one of corner and an edge of adisplayed window generally inwardly into the displayed window.
 9. Themethod of claim 1, wherein the visual effect depicting the current imagebeing at least partially removed from over the underlying image includesone of: (a) showing an opening forming in the current image, the openingincluding one of a hole, a rip, a cut, and a tear; (b) showing thecurrent image being split into a plurality of pieces; or (c) showing thecurrent image being crumpled.
 10. The method of claim 1, wherein afterreceiving the predetermined user input permits access to the at leastone additional function, further comprising the step of initiating theat least one additional function upon one of the following occurring:(a) while the predetermined user input is being maintained, respondingto the user providing an additional user input to trigger execution ofthe at least one additional function; (b) after the predetermined userinput has been made, responding to the user making the additional userinput to trigger execution of the at least one additional functionwithin a predetermined interval of time interval after the predetermineduser input has been made; or (c) after the predetermined user input hasbeen made, responding to the user making the additional user inputbefore any other user input is made.
 11. A memory medium on which arestored machine instructions for carrying out the steps of claim
 1. 12. Amemory medium storing machine instructions for execution on a computingdevice having a graphical user interface presented on a displayconfigured to be responsive to an input made by one of placing andmoving external objects relative to a surface of the display, whereinrelative to the surface of the display includes objects that are near,but not actually touching the surface of the display, said machineinstructions when executed by the computer device, carrying out aplurality of functions, including: (a) associating at least oneadditional function of an application of the computing device with atleast a portion of an underlying image, the at least one additionalfunction visually hidden and inaccessible from a current imageassociated with the application, and the at least one additionalfunction being directly related to manipulation of the current imagevisually hiding the at least one additional function; (b) presenting thecurrent image to a user, the current image covering at least a portionof the underlying image such that access to the at least one additionalfunction is at least partially covered by the current image renderingthe at least one additional function inaccessible from the currentimage; (c) detecting a type of external object adjacent to the surfaceof the display; (d) detecting a predetermined user input made foraccessing the additional function on the underlying image, thepredetermined user input including at least one of: (i) the user placingthe external object adjacent to a surface of the display, whereinadjacent includes objects that are near, but not actually touching theinput responsive display; or ii) the user performing a gesture with theexternal object adjacent to the surface of the display, wherein adjacentincludes objects that are near, but not actually touching the inputresponsive display; (e) upon detecting the external object and thepredetermined user input, initiating a visual effect depicting thecurrent image being at least partially removed from the underlyingimage, revealing the at least one additional function and enablingaccess of the at least one additional function by the user to manipulatethe current image for which the visual effect has been initiated,wherein initiating the visual effect comprises selecting a visual effectfrom a plurality of different available visual effects, wherein theselected visual effect is dependent on the type of the external objectand either location of placement of the external object or the gesturemade with the external object, such that different combinations ofexternal object types, placements and gestures produce different visualeffects; and (f) initiating the at least one additional function andmanipulating the current image upon detecting one of: (i) while thepredetermined user input is being maintained, the user making anadditional user input to trigger the at least one additional function;(ii) after predetermined the user input has been made, the user makingthe additional user input to trigger the at least one additionalfunction within a predetermined interval of time after the predetermineduser input was made; or (iii) after the predetermined user input wasmade, the user making the additional user input before any other userinput is made.
 13. The memory medium of claim 12, wherein the underlyingimage includes at least one of: (a) an exit function for a currentfunction represented by the current image; (b) at least one additionalmenu including a plurality of additional functions not accessible viathe current image; (c) an additional application; or (d) a control foraccessing an operating system function.
 14. The memory medium of claim12, wherein the plurality of functions further include at least one of:(a) responding to the user positioning the external object adjacent to apredetermined area of the display; (b) responding to the userpositioning the external object adjacent to the predetermined area ofthe display and lifting the external object away from the display; (c)responding to the user positioning the external object adjacent to adesignated portion of the current image; (d) responding to the userpositioning the external object adjacent to the display in thedesignated portion of the current image and lifting the external objectaway from the display; or (e) responding to the user performing apredetermined gesture with the external object adjacent to the display,including one of: (i) placing the external object adjacent to a cornerof the predetermined area of the display, and moving the external objectaway from the corner of the predetermined area; (ii) placing theexternal object adjacent to an edge of the predetermined area of thedisplay, and moving the external object away from the edge of thepredetermined area; (iii) placing the external object adjacent to acorner of the current image, and moving the external object away fromthe corner of the current image; (iv) placing the external objectadjacent to an edge of the current image, and moving the external objectaway from the edge of the current image; (v) placing a plurality ofexternal objects adjacent to the display and moving each of theplurality of external objects apart from each other; (vi) placing theexternal object adjacent to a surface of the display and moving theexternal object toward an edge of the display; or (vii) placing theexternal object adjacent to the surface of the display and moving atleast a portion of the external object in a direction generally parallelwith the surface of the display.
 15. The memory medium of claim 12,wherein the external object includes at least one of: (a) a user's hand;or (b) a shape of the external object that is recognized by thecomputing device using the display.
 16. The memory medium of claim 15,wherein the external object is configured to be recognized by thecomputing device as being associated with providing access to theunderlying image, and access is provided to the underlying image uponthe shape of the external object being recognized by the computingdevice.
 17. The memory medium of claim 12, wherein the visual effectdepicting the current image being at least partially removed from overthe underlying image includes one of: (a) showing a corner of thecurrent image being peeled back; (b) showing an edge of the currentimage being peeled back; (c) showing an opening forming in the currentimage, the opening including one of a hole, rip, cut, or tear; (d)showing the current image being split into pieces; (e) showing thecurrent image being crumpled; or (f) showing the current image slidingwithin the display to at least partially visually reveal the at leastthe portion of the underlying image.
 18. The memory medium of claim 12,wherein after receiving the predetermined user input, the machineinstructions cause the computing device to permit access to the at leastone additional function, initiating the at least one additional functionupon one of: (a) while the predetermined user input is being maintained,responding to the user making an additional user input to triggerexecution of the at least one additional function; (b) after thepredetermined user input has been made, responding to the user makingthe additional user input to trigger execution of the at least oneadditional function within a predetermined interval of time intervalafter the predetermined user input has been made; or (c) after thepredetermined user input has been made, responding to the user makingthe additional user input before any other user input is made.
 19. Asystem for providing an input to an application that is being executed,comprising: (a) an interactive display surface adjacent to which aplurality of non-electronic physical objects are manipulated, saidinteractive display surface presenting visual entities; (b) a lightsensor that optically detects a location of the non-electronic physicalobjects that are adjacent to the interactive display surface, whereinadjacent includes non-electronic physical objects that are near, but notactually touching the input responsive display, and wherein said lightsensor detects the location of the physical objects near, but notactually touching the input responsive display; (c) a processor incommunication with the light sensor and the display device; and (d) amemory in communication with the processor, the memory storing data andmachine instructions that cause the processor to carry out a pluralityof functions, including: (i) associating at least one additionalfunction of an application of the computing device with at least aportion of an underlying image that is initially at least partiallyhidden by a current image associated with the application, which atleast one additional function is directly related to manipulation of thecurrent image; (ii) presenting the current image to a user, the currentimage being associated with a current function and covering at least aportion of the underlying image so that the at least one additionalfunction is at least partially covered and obscured by the current imagerendering the at least one additional function inaccessible from thecurrent image; (iii) detecting a type of external object adjacent to thesurface of the display as well as a predetermined user input forproviding access to the underlying image, wherein the detectedpredetermined user input includes at least one of: (1) the user placingthe external object adjacent to the interactive display surface, whereinadjacent includes objects that are near, but not actually touching inputresponsive display; or (2) the user performing a gesture with theexternal object adjacent to the interactive display surface, whereinadjacent includes objects that are near, but not actually touching theinput responsive display; and (iv) upon detecting the type of externalobject and the predetermined user input, initiating a visual effectdepicting the current image being at least partially removed from overthe underlying image to thereby visually expose and enable access by auser to the at least one additional function, which was previously atleast partially hidden by the current image and which allowsmanipulation of the current image previously partially removed from overthe at least one additional function, wherein initiating the visualeffect comprises selecting a visual effect from a plurality of differentavailable visual effects, wherein the selected visual effect isdependent on the type of the external object and the predetermined userinput, such that different combinations of external object types andpredetermined user inputs produces different visual effects.
 20. Thesystem of claim 19, further comprising at least one non-electronicexternal object, and wherein the predetermined user input includes atleast one of: (a) positioning the at least one non-electronic externalobject adjacent to a predetermined area of the display, wherein adjacentincludes objects that are near, but not actually touching the inputresponsive display; (b) positioning the at least one external objectadjacent to the predetermined area of the display and lifting at leastone external object away from the display, wherein adjacent includesobjects that are near, but not actually touching the input responsivedisplay; (c) positioning the at least one external object adjacent to adesignated portion of the current image, wherein adjacent includesobjects that are near, but not actually touching the input responsivedisplay; (d) positioning the at least one external object adjacent tothe designated portion of the current image and lifting at least oneexternal object away from the display, wherein adjacent includes objectsthat are near, but not actually touching the input responsive display;or (e) performing a predetermined gesture with the external objectadjacent to the display, including one of: (i) placing the at least oneexternal object adjacent to a corner of the predetermined area of thedisplay, and moving at least one external object away from the corner ofthe predetermined area; (ii) placing the at least one external objectadjacent to an edge of the predetermined area of the display, and movingat least one external object away from the edge of the predeterminedarea; (iii) placing the at least one external object adjacent to acorner of the current image, and moving at least one external objectaway from the corner of the current image; (iv) placing the at least oneexternal object adjacent to an edge of the current image, and moving atleast one external object away from the edge of the current image; (v)placing a plurality of external objects adjacent to the display andmoving at least some of the plurality of external objects apart fromeach other; (vi) placing the at least one external object adjacent to asurface of the display and moving at least one external object toward anedge of the display; or (vii) placing the external object adjacent tothe surface of the display and moving at least a portion of at least oneexternal object in a direction generally parallel with the surface ofthe display.
 21. The system of claim 19, wherein the visual effectdepicting the current image being at least partially removed from overthe underlying image includes one of: (a) showing the current imagebeing split into a plurality of pieces; or (b) showing the current imagebeing crumpled.